Comunicar, n. 44 , v. XXII, 2015 | Media Education Research Journal | eJSSN: 1988-3293 


www.comunicarjoumal.com 


Design, Motivation and Performance in a 
Cooperative MOOC Course 



Diseno, motivacion y rendimiento en un curso MOOC cooperativo 


□ Dr. Carlos Castano is Senior Lecturer in the Department of Didactics and School Organization at the Universidad 
del Pais Vasco (Spain) (carlos.castano@ehu.es). 

Q] Dr. Inmaculada Maiz is Senior Lecturer in the Department of Evolution Psychology and Education at the 
Universidad del Pais Vasco (Spain) (inmaculada.maiz@ehu.es). 

□ Dr. Urtza Garay is Associate Professor at the Department of Language and Literature Didactics at the Universidad 
del Pais Vasco (Spain) (urtza.garay@ehu.es). 


ABSTRACT 

MOOCs are seen as the latest evolution in online learning and, since their launch in 2008, they have become an integral part of 
university course curricula. Despite the social success of these courses, the learning design and efficacy of their results have been 
questioned. Most current research has focused more on discussing their potential to offer quality, large-scale education worldwi- 
de rather than measuring learning outcomes. This paper shows the results of a research study that focused on the pedagogical 
design of a cooperative MOOC and its influence on motivation and academic results. A Delphi study was used to validate the 
design, and the motivation variable was controlled using the Instructional Materials Motivation Survey (IMMS). Academic per- 
formance was assessed through evidence-based learning. The paper argues that design, which is defined by the students' inten- 
sive use of social networks and the activities they carry out in their Personal Learning Environments, has an influence on perfor- 
mance, and the variable that mediates in that relationship is the level of satisfaction with the perception of the design. The aca- 
demic results obtained and the students’ motivation support the use of cooperative MOOCs in university education. 

RESUMEN 

Los cursos MOOC se han entendido como la ultima evolucion del aprendizaje en red, y desde su nacimiento en 2008 se han 
puesto en practica en un buen numero de universidades. A pesar del exito social de estas propuestas, tanto el diseno del apren- 
dizaje como la eficacia de sus resultados han sido puestos en duda. Actualmente la mayoria de las publicaciones se centran mas 
en discutir su potencial para ofrecer educacion de calidad en todo el mundo a gran escala que en la medicion rigurosa de los 
resultados de aprendizaje. El presente trabajo muestra los resultados de una investigacion centrada en el diseno pedagogico de 
un curso MOOC cooperativo y su influencia en la motivacion y en los resultados academicos obtenidos. El diseno se ha validado 
a traves de un estudio Delphi y la variable «motivacion» se ha controlado a traves de un instrumento estandarizado (Instructional 
Materials Motivation Survey, IMMS). El rendimiento academico se ha evaluado a traves de evidencias de aprendizaje. Se defien- 
de que el diseno, definido por una utilizacion intensiva de redes sociales y realizacion de actividades por parte de los estudiantes 
en sus Entornos Personales de Aprendizaje, influye en el rendimiento, y es la satisfaccion con la percepcion del diseno la variable 
que media en dicha relacion. Los resultados academicos obtenidos y la motivacion de los estudiantes avalan la utilizacion de cur- 
sos MOOC cooperativos en estudios universitarios. 
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1 . Introduction and state of the question 

MOOCs have featured prominently in the scienti- 
fic literature recently as a new way to provide training 
which is attracting millions of students across the 
world and forcing universities to reformulate their on- 
line education courses. MOOCs are seen to represent 
the next evolution in e-learning within a continuum 
which, according to Conole (2014), spans the earliest 
movements in multimedia in the 1 980s to the MOOC 
that first emerged in 2008 followed by Learning 
Analytics two years later. The scale of MOOCs, the 
speed at which they have grown and the difficult 
questions they pose are increasingly prominent as the 
purpose of Higher Education and the very future of 
the university comes under scrutiny. It clearly indicates 
that something new is happening, something more 
than a mere trend. So, this is a subject of particular 
concern to anybody seriously interested in the digital 
future of education. 

The interest this subject arouses is seen in a body 
of research centred on various MOOC projects. 
Works by Liyanagunawardena, Adams &- Williams 
(2013), Castano (2013) and Karsenti (2013) were sys- 
tematic studies of investigations into MOOCs between 
2008 and 2013. The main lines of research included 
the pedagogical design of MOOCs, interaction betwe- 
en students and the perspectives for learning and its 
associated variables (motivation, attitudes and perspec- 
tives). Other aspects were cost, universal accessibility 
to Higher Education and the problem of student drop- 
out rates. 

Many authors state that MOOC are substandard 
in terms of educational rigour (Vardi, 2012; Zapata- 
Ros, 2013), and that the current discourse on MOOCs 
merely reflects strategic, institutional, economic, social 
and technological concerns whereas there is no real 
discussion of the courses’ pedagogical value (Gukdia, 
Maina &- Sangra, 2013: 4). 

Despite these criticisms, and the fact that MOOC 
constitute a type of education that is flexible but not 
widely standardized (Shirky, 2013), various authors 
suggest there is a difference between c-MOOC (con- 
nectivist) and the more traditional x-MOOC (Dow- 
nes, 2011: Siemens, 2012a: Rodriguez, 2013), making 
it impossible to talk of a single pedagogical design. 
Rodriguez (2012) analysed several courses of both 
tendencies and established that the difference betwe- 
en the two lies in their theory of learning and pedago- 
gical model. 

This initial description was too simplistic and is 
now more complex. Knox, Bayne, Macleod, Ross and 
Sinclair (2012) attempted to overcome these deficien- 


cies by incorporating more interesting and innovative 
e-learning practices into their «E-learning and Digital 
Cultures* course, giving preference to content submis- 
sion to the social networks of the process, the commu- 
nity and learning. 

This proposal is in line with Lane (2012) who 
encountered difficulties in situating her approach wit- 
hin the «Stanford Model* versus the «Connectivist 
MOOC* debate, and proposed her own task-based 
project called s-MOOC (skills-MOOC). 

This simplistic x-MOOC and c-MOOC classifica- 
tion has been bypassed thanks to alternative descrip- 
tions of the nature of MOOCs. Downes (2013) sug- 
gests four criteria: autonomy, diversity, openness and 
interactivity. Going further, Clark (2013) deploys a 
taxonomy of eight different MOOC types, claiming 
that they can be located at any point along the spec- 
trum of traditional online courses. Conole (2013) pro- 
poses that they be classified as a set of 1 2 dimensions, 
which makes MOOC design even more complex. 

In this sense cooperative MOOCs try to respond 
to MOOC student heterogeneity by producing an X- 
type course that nevertheless incorporates the advan- 
tages of connectivist courses (Fidalgo, Sein-Echaluze 
&- Garcia Penalvo, 2013): intensive use of social net- 
works, creation of learning communities (Alario- 
Hoyos &- al., 2013) and the deployment of RLE, or 
personal learning environments (Castano &- Cabero, 
2013: 102). 

The efficacy of online training and MOOCs con- 
tinue to represent an evolution in e-learning (Conole, 
2014), and this theme is well-established in numerous 
research meta-analyses (Cabero, 2008: Means, To- 
yama, Murphy, Bakia &- Jones, 2010). Although seve- 
ral studies have indicated that the pedagogical founda- 
tions of MOOCs are solid according to the various for- 
mats they employ (Glance, Forsey &- Riley, 2013: Son- 
walkar, 2013), the influence of different MOOC 
designs on learning outcomes has yet to be adequately 
researched. References to this theme are found in con- 
nectivist courses, the only in-depth studies are by Kop 
&- Fournier (201 1), Kop, Fournier &- Mak (201 1) and 
De Waard (2011, 2013), focussing more on their 
transformative effects on the conventional structures of 
knowledge generation than rigorously measuring lear- 
ning outcomes. 

From another viewpoint, some studies point to the 
potential of MOOCs to spur student autonomy (Kop, 
Fournier &- Mak, 2011: Milligan, Littlejohn &- Margar- 
yan, 2014) and develop 21st century competences 
(Yeager, Hurley-Dasgupta &- Bliss 2013: Sangra &- 
Wheeler, 2013). 
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Motivation has already been identified by Milligan, 
Littlejohn &- Margaryan (2013) as a variable that en- 
hances participation and academic success among stU' 
dents. Similar studies have recently appeared, such as 
Cheng (2014) on emotional competence in MOOC 
students, and Veletsianos (2013) on student learning 
experiences on MOOCs. 

Research has also given rise to more sceptical voi' 
ces on the use of MOOCs in Higher Education. Some 
authors show that the advantages of MOOCs are no 
different from those that were already known from 
distance learning (Fini, 2009; Yuan &- Powell, 2013; 
Harder, 2013). 

It is also known that student 
dropout rates have increased with 
the appearance of MOOCs. 

However, as Liyanaguna 
wardena, Adams &- Williams 
(2013) point out, data on 
MOOC dropout rates are not 
readily available. Jordan 
(2013) examined 24 MOOCs 
and found that the highest rate 
of course completion was 
19.2% while most barely rea- 
ched 1 0%. Liyanagunawar' 
dena, Parslow &- Williams 
(20 1 4) show that MOOC stU' 
dents do not typically drop out for financial reasons 
since they do not pay enrolment or tuition fees; these 
authors suggest that abandonment has more to do with 
dissatisfaction at not achieving personal objectives. 

2. Research method 

The aim of this investigation is to analyse the peda- 
gogical design of a cooperative MOOC and measure 
its influence on student motivation and academic 
results. The questions addressed are; 

a) Is there a relationship between academic per- 
formance and the pedagogical design of the course? 

b) Is there a relationship between student motiva' 
tion and the pedagogical design of the course? 

c) Is there a relationship between academic per- 
formance and student motivation? 

One of the mainstays of this research was the 
pedagogical design of the course which was coopera- 
five in nature. For the design of the MOOC, we 
carried out a Delphi double to string study with 53 
experts in e'learning and ICTs from European and 
Latin American universities. We asked them about 
MOOC types, ways of learning and assessment met' 
hods, and the roles and functions of tutors. We took 


their responses and resubmitted the design of the cout' 
se, located on the Chamilo Metauniversity open sour' 
ce e'learning platform under GNU/GPLv3 licensing. 

In addition, and to foment interaction between 
participants, we actively encouraged students to use 
social networks (Twitter, Skype, blogs, Facebook, 
Linkedin, etc.). The platform’s technical limitations 
were overcome by opening a Ning website to allow 
students to socially interact and discuss their contribu' 
tions. They did e'activities on a weekly basis, all of 
which helped participants to construct their own RLE. 

The statistical analysis of the data was carried out 


with the SPSS version 22 program. In the data collec' 
tion process, besides the assessment of the e'activities 
by the tutors, there was a set of four questions on the 
course design with responses measured on the Likert 
scale. 

The data on motivation was gathered by means of 
an IMMS (Instructional Materials Motivation Survey) 
which the MOOC students completed at the end of 
the course. This was a Likert'type questionnaire made 
up of 36 items divided into four categories (attention, 
confidence, satisfaction and relevance) based on 
Keller’s ARCS motivation model (1987). In this case 
we took the proposal of Di Serio, Ibanez &- Delgado 
(2013) with a documented reliability coefficient of 
0.96 and adapted it slightly to fit MOOCs. 

2.1. Sample 

The course was designed for students in the 
fourth year of a Primary Education degree course at 
the Universidad del Pafs Vasco, although the very 
nature of the MOOC meant that it was accessible on 
the Net to all those interested in this subject, in line 
with other MOOC experiences (Siemens, 2012b; 
Knox, Bayne, Macleod, Ross &- Sinclair, 2012). 


MOOCs have featured prominently in the scientific 
literature recently as a new way to provide training which is 
attracting millions of students across the world and forcing 
universities to reformulate their online education courses. 
MOOCs are seen to represent the next evolution in 
e-learning within a continuum. 
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Of the 744 students who enrolled on the MOOC 
the sample consisted of 1 86 participants, classified as 
N in the research. In terms of the dropout rate, 1 86 
students began the course, 25.83% of those who had 
signed up, and 88 completed the course, 1 1 .82%. 
Sample attrition was in line with general MOOC drop- 
out rates although participation was slightly higher than 
the 10% indicated by Jordan (2013). 

3. Analysis and results 

We present the analysis of the data yielded by the 
scales used (IMMS and the scale for the course 
design) in the order of the research questions posed. 
The global results of the correlational analysis also 
come with a study based on the division of the 
MOOC students into two groups according to age, 
those who are 3 1 or under and those over 3 1 , since 
the first group was formed of undergraduates and the 
second group was not. 

The course design is based on 
four variables assessed by the particf 
pants using the Likert scale applied to 
these four items: the use of small video 
packages is a good idea: 1 was able to 
control the development of the course 
with ease thanks to carrying out e-acti' 
vities: interaction with course collea' 
gues via the network enhances lear- 
ning; the use of a social network as a 
course complement has helped me to 
follow the course. 

In reference to the first research 
question (Is there a relationship between academic 
performance and the pedagogical design of the cour- 
se?), a direct relationship between these two factors is 
observed. The relationship is significant both in the 
overall result and in the results for the two age groups 
(table 1). The four items on the scale that relate to the 
course design were valued positively or very positively 
by 85% of the students. 

The second research question (Is there a relations- 
hip between student motivation and the pedagogical 
design of the course?) emphasises the potential rela- 
tionship between motivation and course design. The 
results in table 2 show a direct link between the type 
of course design and student motivation. The correla- 
tional analysis of the total sample is significant in this 
global aspect and is supported by the significance that 
emerges for each of the factors (attention, confidence, 
satisfaction and relevance) on which the level of moti- 
vation is based, according to the IMMS scale. These 
results are significant and they appear in all the factors 


and among all the students in the two age groups, just 
as occurred with the first research question. Thus, we 
can state that the course design influences student 
motivation. 

Thus we can state that there exists a direct rela- 
tionship between each of the four factors that measure 
motivation and course design. 

With regard to the attention variable, the results 
(table 3) confirm that the items related to methodology 
(items 2 and 8), quality (11, 12, 15, 28 and 29), orga- 
nization (17, 20 and 31) and use of material (22 and 
24), as well as interaction via Internet (19), all positi- 
vely contribute to student motivation on the MOOC. 

In addition, there is an increase in each individual’s 
confidence in learning, as gathered in the second fac- 
tor on the IMMS scale (items 1 , 3, 4, 7, 13, 25, 34 and 
35 in table 3) 

The same result is found in the factors that corres- 
pond to satisfaction and relevance (table 2). According 


to the data (table 4), the course design (items 6, 27, 
and 36) together with the material (9, 16, 18, 23 and 
33), and the development of the MOOC (5, 10, 21 
and 32) is relevant and satisfactory (14, 26 and 30). 

The results for the third research question (Is there 
a relationship between academic performance and 
student motivation?) were different in terms of global 
perspective and age group. 

The following results show that although there is 
no direct overall relationship between academic per- 
formance and motivation, there is some significance in 
the global relationship between performance and one 
of the IMMS factors, this being student satisfaction 
(table 5). 

This significance is also seen in the students aged 
over 31 yet it has no correlation in the younger age 
group, 31 and under (table 5). 

These results lead us to state that there is no direct 
relationship between global motivation and perfor- 
mance, yet there exists such a relationship between 


Table 1. Total sample correlations by age group between 
performance and design 





PERFORMANCE 

DESIGN 

PERFORMANCE 

Total sample 

Pearson's r 

1 

.264* 



■dBWiaiBBglM 


0.015 



N 

186 

84 


<=31 

Pearson's r 

1 

.268* 








N 

96 

56 


>31 

Pearson's r 

1 

.442* 



SIg. (bilateral) 





N 

83 

1 22 
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Table 2. Correlations for the total sample and the two age groups between 


design and IMMS scale factors 





DESIGN 

ATTENTION 

CONFI. 

SATISF. 

RELEVANCE 

TOTAL 

IMMS 

DESIGN 

Total 

Pearson’s r 

1 

.558" 

.363" 

.631" 

.529** 

.588** 


sample 

Sig. (bilateral) 


.000 

.001 

.000 

.000 

.000 



N 

85 

81 

83 

84 

84 

80 


<=31 

Pearson's r 

1 

595" 

,331* 

643" 

595" 

622" 



Sig. (bilateral) 


^55" 

015 

.000 

^(3o" 

000 



N 

56 

54 

54 

55 

55 

53 


>31 

Pearson's r 

1 

.613" 

,503* 

,697" 

439* 

585** 



Sig. (bilateral) 


.003 

014 

.000 

036 

005 



N 

23 

21 

23 

23 

23 

21 


global motivation and one of the factors that constitU' 
tes motivation, namely satisfaction. Overall, satisfaC' 
tion correlates directly to student performance on the 
MOOC. 

Finally, an analysis was made of the mediation of 
the satisfaction factor in the relationship between 
course design and performance in the total sample. 
With the introduction of the mediatory variable (satiS' 
faction) the relationship between the design factor and 
performance disap' 
pears and ceases to 
be significant, 
which means that 
the relationship be' 
tween design and 
performance is 
based on the satiS' 
faction factor be' 
cause, when it is 
controlled, the pre' 
vious relationship is 
nullified: b = 0.25* 

(E.T. = 0.10)/b = 

0.16ns (E.T = 

0.12) (*p < .01). 

Hence, satisfaction 
mediates between 
design and perfot' 
mance, so the grea' 
ter the satisfaction 
with the design of 
the course, the bet' 
ter the student pet' 
formance. 


4. Discussion md 
conclusions 

MOOCs are 
defined by the huge 
number of students 


they attract 
and their 
heteroge' 
neity, and 
also by high 
dropout 
rates. The 
study shows 
that a mixed 
course 
design that is 
cooperative 

in nature and which incorporates social networks as a 
learning strategy can help to reduce this phenomenon 
(Fidalgo, Sein'Echaluze &- Garcia Penalvo, 2013). 
These data reinforce the validity of interaction for lear' 
ning on online courses, as shown in previous research 
(Vidal &- Camarena, 2014). 

Course design influences performance since there 
is a direct significance between both factors in the glo' 



IMMS 

1 % 1 

Items related to the Attention factor (1 strongly disagree, 6 strongly 
agree). 

1 

2 

3 

4 

5 

6 

2. 1 noticed something interesting when this MOOC first caught my 
attention. 

1.1 

11.7 

8.2 

21.1 

30.5 

27 

8. The MOOC methodology really stands out. 

11 

0 

2.3 

17.6 

35.2 

42.3 

1 1 . The quality of the material helped to hold my attention throughout 
the course. 

1.1 

2.3 

3.5 

25,8 

48.2 

18.8 

12. The material is so abstract that it was difficult to keep focussed on 
it. (Inverted) 

11.7 

42.3 

28.2 

10.5 

4.7 

2.3 

15. The videos and texts that were part of the course were not in the 
least attrxtive. (Inverted) 

24.7 

29.4 

32.9 

10.5 

1.1 

1.1 

17. The way the information is organized helped to hold my attention 
throughout the course. 

1.1 

1.1 

7.05 

29,4 

47.05 

14.1 

19. Interaction with my course colleagues via Internet helped to hold 
my attention throughout the course. 

3.5 

8.2 

7.05 

25.8 

38.8 

16.4 

20. The information 1 found throughout my learning experience on the 
course aroused my curiosity. 

0 

8.2 

2.3 

14.1 

51.7 

23.5 

22. 1 found that the number of e-activities 1 had to do was annoying. 

11.7 

29.4 

34.1 

10.5 

9.4 

4.7 

24. Carrying out the e-activities helped to hold my attention throughout 
the course. 

2.3 

2.3 

7.05 

22.3 

42.3 

23.5 

28. The variety of the audiovisual material helped to hold my attention 
throughout the course. 

1.1 

1.1 

5.8 

35.2 

38.8 

17.6 

29. The audiovisual material is boring. 

28.2 

32.9 

25.8 

9.4 

2.3 

1.1 

31. There is so much content that it is annoying. 

17.6 

35.2 

24.7 

15.2 

5.8 

1.1 

1 Items related to the Confidence factor I 

1 . When 1 first saw this course. 1 thought 1 would find it easy. 

17.6 

16.4 

22.3 

24.7 

16.4 

2.3 

3. This material was more difficult to understand than 1 would have 
liked. 

7.05 

29.4 

15.2 

31.7 

12.9 

3.5 

4. Following the presentation of the information. 1 felt sure 1 knew what 
it was that 1 had to learn on this course. 

1.1 

3.5 

17.6 

22.3 

43.5 

11.7 

7. There was so much information that it was difficult to recall the most 
important points. 

3.5 

20 

28,2 

34.1 

9.4 

4.7 

13. As 1 was working through the course. 1 felt sure that 1 could learn 
from the content. 

0 

1.1 

7.05 

21.1 

45.8 

24.7 

25. After working a while on this course, 1 felt sure that 1 could pass an 
exam on the subiect. 

0 

4.7 

9.4 

32,9 

43.5 

9.4 

34. 1 could not understand most of the course material. 

23.5 

45.8 

15.2 

11.7 

2.3 

1.1 

35. The material was well-organized, which gave me the confidence to 
believe 1 could learn from it. 

0 

1.1 

4.7 

32,9 

41.1 

20 
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IMMS 

% 

Items related to the Satisfaction factor (1 strongly disagree, 6 strongly 
agree). 

1 

2 

3 

4 

5 

6 

5. Carrying out e-activities on this course gave me a feeling of satisfaction 
at having achieved something. 

1.1 

2.3 

0 

14.1 

34.1 

34.1 

14. 1 enjoyed this course so much that I would like to know more about 
the subiect. 

1.1 

4.7 

9.4 

~15T 

15T 

25.8 

21. 1 really enjoyed studying this course. 

3.5 

5.8 

5.8 

15.2 

44.7 

24.7 

27. The comments 1 received on completing an exercise, or during my 
course work, made me feel that my hard work had been worth it. 

3.5 

7.05 

8.2 

37.6 

34,1 

9.4 

32. 1 feel good about having completed the course satisfactorily. 

2.3 

3.5 

2.3 

8.2 

32.9 

50.5 

36. It was a pleasure to work on such a well-designed course. 

1.1 

2.3 

5,8 

27.7 

30.5 

35.5 

Items related to the Relevance factor 

6. For me the content of the material is clearly related to things 1 already 
know. 

0 

9.4 

14.1 

28.2 

40 

8.2 

9. There are videos and texts that show me that this material could be 
important to some people. 

0 

0 

0 

5.8 

44.7 

49.4 

10. Completing the e-activlties satisfactorily was Important to me. 

1.1 

2.3 

2,3 

3.5 

40 

50.5 

16. The content of this material is relevant to my personal interests. 

1.1 

4.7 

10.5 

18.8 

31,7 

32.9 

18. There are explanations or examples of how to use the knowledge 
acquired on this course. 

0 

4.7 

3,5 

35,2 

43.5 

12.9 

23. The content and audiovisual material on this course give me the 
impression that they are worth knowing. 

0 

1.1 

4.7 

29.4 

44.7 

20 

26. This course was irrelevant to my needs because 1 already knew most 
of the content. 

45.8 

35.2 

11.7 

4.7 

1,1 

1.1 

30. 1 can relate the course content to things 1 have seen or done, or to 
issues 1 have thought about in my life. 

0 

2.3 

2.3 

27.05 

45.8 

22.3 

33. The course content will be useful for me. 

1.1 

2.3 

2.3 

15.2 

27 

50.5 


bal result and in 
the characteris' 
tics of the peda' 
gogical design 
proposed (use 
of inicrO'Con' 
tent, video mi' 
cro'packages, 
intensive social 
network activity 
and the cart' 
ying'Out of onli' 
ne activities 
within students’ 
own PLE). 

Likewise 
there is a direct 
link between 
course design 
and the four 
motivational 
factors on the 
IMMS scale: 
attention, confi' 
dence, satisfac' 
tion and rele' 
vance. This connection affects methodology and the 
quality and organization of the written and multimedia 
material used on the course as well as the interaction 
between students. These data reinforce the potential 
of cooperative designs for learning in Higher Edu' 
cation. 

Yet this does not occur when the scale and its four 
motivational factors correlate to academic performan' 
ce. There is no global significance between motivation 
and performance, but we observe that one of the fac' 
tors on the IMMS scale, satisfaction, indicates that 
there is a direct link to performance in the global 
results and in references to students over 3 1 years old. 
At a time when universities are rethinking their online 
training courses, traditional MOOCs may attract new 
students to university but it is cooperative MOOCs 
that can increase the level of student satisfaction and 
help cut dropout rates. Possibly a hybrid design like the 
one proposed here fits better with the different types 
of student that take MOOCs (Milligan, Littlejohn &- 
Margaryan, 2013), and enables them to reach their 
personal objectives (Liyanagunawardena, Parslow &- 
Williams, 2014). This would allow universities to 
offer continuous training and Lifelong Learning with 
course designs that better adapt to students’ needs. 
Indirectly, it also reveals the capacity of this pedagogi' 


cal design to develop in students those learning com' 
petences that are essential in the 2 1 st century. 

Finally, the general sample’s level of satisfaction 
derived from the positive perception of a good course 
design and the consequent, good academic perfot' 
mance achieved by those students supports the use of 
massive open online courses in graduate studies. 

After the analysis of the mediation of the satisfaC' 
tion factor in the relationship between the pedagogical 
design of the course and performance, we observe 
that the relationship between both ceases to be signifi' 
cant. It is, therefore, the level of satisfaction regarding 
the pedagogical design of the course that influences 
academic outcomes. It would be interesting to broa' 
den these results with an analysis of students’ learning 
experiences on MOOCs. 

Support and acknowledgement 

This research project was financed by the UPV/EHU: «Rendimien-' 
to y nivel de salisfaccion de los participantes en un curso on-line 
masivo y abierto (MOOCs)» {Performance and level of student 
satisfaction with massive open online courses), reference number: 

EHU 13/59, granted in 2013. 

References 

AlariO'Hoyos, C., PereZ'Sanagustin, M., Delgado-Kloos, C., 
PARADA, H.A., MUNOZ'ORGANERO, M. &- RODRIOUEZ'DE'tAS'HE' 


© ISSN: 1 134-3478 • e-ISSN: 1988-3293 • Pages 19-26 



25 






PERF. 

AHENTION 

CONFI. 

SATISF. 

RELEVANCE 

TOTAL 

IMMS 

PERFORMANCE 

Total 

sample 

Peatson's r 

Sig.(bilateral) 

N 

1 

186 

.025 

.827 

81 

.048 

.667 

83 

.244 

.025 

84 

.166 

.130 

84 

.085 

.453 

80 


<=31 

Peatson's r 

1 

,157 

,264 

.110 

.163 

,240 



Siq.(bilaleral) 


.257 

.054 

.426 

.235 

.084 



N 

96 

54 

54 

55 

55 

53 


>31 

Pearson's r 

1 

.227 

.209 

.432" 

.172 

,220 



Sig.(b;lateral) 


.322 

338 

.040 

.434 

.339 



N 

83 

21 

23 

23 

23 

21 


RAS, A. (2013). Analysing 
the Impact of Built-in and 
External Social Tools in 
a MOOC on Educatio- 
nal Technologies. In D. 

HernandeZ'Leo, T. 

Ley, R. Klamma &- A. 

Harrer (Eds.), Scaling 
Up Learning for Sus- 
tained Impact (pp. 5- 
18). Berlin, Germany: 

Springer Berlin Heidel- 
berg. (DOI: http://doi.' 
org/tkh). 

Cabero, J. (Dir.) (2008). E-learning: Metaonolisis de investigacio- 
nes y resultados alcanzados. Informe final. (http://goo.gl/0ayp3E) 
(30-04-2014). 

Castano, C. (2013). Tendencias en la investigacion en MOOC. 
Primeros resultados. (http://goo.gl/mBKuTi) (10-12-2013). 
Castano, C. U Cabero, J. (Coords.) (2013). Enseiiary aprender 
en entornos m-learning. Madrid: Smtesis. 

Cheng, J.C.Y. (2014). An Exploratory Study of Emotional Affor- 
dance of a Massive Open Online Course. European Journal of 
Open, Distance and e-Learning 17, 1 43-55. (http://goo.gl/sJuxAh) 
(15-03-2014). 

Clark, D. (2013). MOOCs: Taxonomy of 8 Tipes of MOOCs. 
(hitp://goo.glAA^A9XH) (09-12-2013). 

CONOLE, G. (2013). Los MOOC como tecnologias disruptivas: 
estrategias para mejorar la experiencia de aprendizaje y la calidad de 
los MOOC. Campus Virtuales, 2, 16-28. (http://goo.gl/EK9ZPI) 
(10-04-2014). 

CoNOLE, G. (2014). Reviewing the Trajectories of E-learning. 
(http://goo.gl/Ferxef) (08-0 1 -20 1 4). 

De Waard, I., Abajian, S. &- AL. (2011). Using mLearning and 
MOOCs to Understand Chaos, Emergence, and Complexity in 
Education. International Review of Research in Open and Distan- 
ce Learning, I2{7) (http://goo.gi/wxdMZt) (28-04-2014). 

De Waard, I. (2013). Analyzing the Impact of Mobile Acces on 
Learner Interactions in a MOOC. A Thesis Submitted to the Fa- 
culty of Graduate Studies. Athabasca University; Centre for 
Distance Education. (http://goo.gl/vWYLoe) (28-04-2014). 

Di Serio, a., Ibanez, B. Delgado, C. (2013). Impact of an 
Augmented Reality System on Students 'Motivation for a Visual Art 
Course. Computers S- Education, 68, 586-596. (http://goo.gl/s3zB- 
cp) (DOI: http://doi.org/tkq) (09-04-2014). 

Downes, S. (2011). Connectivism and Connective Knowledge. 
(http://goo.gl/q 1 eEht) (25-04-20 1 4). 

Downes, S. (2013). Week2:The Quality of Massive Open Online 
Courses. (http://goo.gWV57f7A) (14-04-2014). 

Fidalgo, a., Sein-Echaluce, M.L. Garcia-Penalvo, F.J. (2013). 
MOOC cooperativo. Una inlegracidn entre cMOOC y xMOOC. 
In A. Fidalgo, M.L. Sein-Echaluce (Eds.), Actas del II Congreso 
Internacional sobre Aprendizaje, Innovacion y Competitividad, 
CINAIC (pp. 481-486). Madrid: Universidad Politecnica de Ma- 
drid. (http://goo.gl/oxA06L) (09-04-2014). 

FlNi, A. (2009). The Technological Dimension of a Massive Open 
Online Course: The Case of the CCK08 Course Tools. Inter- 
national Review of Research in Open and Distance Learning, 
I0{5). (http://goo.gi/xuBAOV) (29-04-2014). 

Glance, D.G., Forsey, M. U Riley, M. (2013). The Pedagogical 
Foundations of Massive Open Online Courses. First Monday, 18, 
5. (http://goo.gl/WVQllC) (DOI: http://doi.org/tkp). 


Guarda, L„ Maina, M. U Sangra, A. (2013). MOOCs Design 
Principles: A Pedagogical Approach from the Learner’s Perspective. 
(http://goo.gl/G4Rjxt) (15-1 2-2013). 

Harder, B. (2013). Are MOOCs the Future of Medical Education? 
BMJ, 346. (DOI: http://doi.org/tks). 

Jordan, K. (2013). MOOCs Completion Rates: The Data, (http://- 
goo.gl/73AxVf) (15-12-2013). 

Karsenti, T. (2013). The MOOCs. What the Research Says. 
International Journal of Technologies in Higher Education, I0{2), 
23-37. 

Keller, J.M. (1987). Strategies for Stimulating the Motivation to 
Learn. Performance and Instruction, 26{8), 1-7. 

Knox, J„ Bayne, S., Macleod, H., Ross, J. U Sinclair, C. (2012). 
MOOCs Pedagogy: the Challanges of Developing for Coursera. 
(http://goo.gl/z8pQbP) (03- 1 2-20 1 3) . 

KOP, R. Lr Fournier, H. (201 1). New Dimensions to Self-directed 
Learning in an Open Networked Learning Environment. Inter- 
national Journal of Self-Directed Learning, 7,2, 1-18. 

KoP, R., Fournier, H. &- Mak, S.F.J. (201 1). A Pedagogy of Abun- 
dance or a Pedagogy to Support Human Beings? Participant 
Support on Massive Open Online Courses. International Review of 
Research in Open and Distance Learning, Special Issue - Emergent 
Learning, Connections, Design for Learning, 12, 7, 74-93. 

Lane, L. (2012). Three Kinds of MOOCs. (http://goo.gl/lwTkTA) 
(10-12-2013). 

Liyanagunawardena, T.R., Adams, A.A. U Williams, S.A. (2013). 
MOOCs: A Systematic Study of the Published Literature 2008-12. 
The International Review of Research in Open and Distance Edu- 
cation, 14, 3, 202-227. (http://goo.gl/GMqlB2) (01-03-2014). 
Liyanagunawardena, T.R., Parslow, P. Williams, S.A. (2014). 
Dropout: MOOCs Participants’ Perspective. In U. Crees 6- C. 
Delgado (Eds.), Proceedings of the European MOOCs Stakeholder 
Summit 2014, 95-100 (http://goo.gl/8BEVHM) (25-04-2014). 
Means, B.,Toyama, Y., Murphy, R„ Bakia, M. U Jones, K. (2010). 
Evaluation of Evidence-based Practices in Online Learning: A 
meta-analysis and Review of Online Learning Studies. Washing- 
ton, D.C.: U.S. Department of Education. (http://goo.gl/Yh6tgU) 
(27-04-2014). 

Milligan, C., Littlejohn, A. U Margaryan, A. (2013). Patterns 
of Engagement in Connectivist MOOCs. Journal of Online Learn- 
ing and leaching, 9(2), 149-159. (http://goo.gl/7ALBbo) (30-04- 
2014). 

Milligan, C„ Littlejohn, A. U Margaryan, A. (2014). Work- 
place Learning in Informal Networks. Journal of Interactive Media 
Environments, 0. (http://goo.gl/tqfHaq) (30-04-2014). 

Rodriguez, C.O. (2012). MOOCs and de Al-Stanford like courses: 
Two Successful and Distinct Course Formats for Massive Open 
Online Courses. European Journal of Open, Distance and E- 


ISSN: 1134-3478 • e-lSSN: 1988-3293 • Pages 19-26 


Comunicar, 44, XXII, 2015 




Comunicar, 44, XXII, 2015 


26 


Learning, 2012 (II). (http://goo.gl/Jt8WfV) (25-04-2014). 
Rodriguez, C.O. (2013). The Concept of Openness Behind c and 
X'MOOCs (Massive Open Online Courses). Open Praxis, 5(1), 
67T3. (http://goo.gI/JwG34l) (14^04^2014). 

Sangra, a. &- Wheeler, S. (2013). New Informal Ways of Learn' 
ing: Or Are we Formalising the Informal? Revista de Universidad y 
Sociedaddel Conocimiento, I0{\), 286'293. (http://goo.gl/Z7mSi7) 
(DOl: http://doi.org/tkt) (30'04'2014). 

Shirky, C. (2013). MOOCs and Economic Reality, (http://goo.gl/' 
gw3fWZ) (28'04'2014). 

Siemens, G. (2012a). AfOOCs are Really a Platform. (http://goo.' 
gl/Jt8WfV) (18'04'2014). 

Siemens, G. (2012b). What is the Theory that Underpins ‘our’ 
MOOCs? (http://goo.gl/G71Jh6) (28'03'2014). 

SONWALKAR, N. (2013). Why the MOOCs Forum now? AfOOCs 
Forum, /(I). (http://goo.gl/LXbBhq) (30'04'2014). 

Vardi, M.Y. (2012). Will MOOCs Destroy Academia? Com- 
munications of the ACM, 55(1 1), 5. (http://goo.gl/hpnvWe) (DOI: 


http://doi.org/tkv) (30'04'2014). 

Veletsianos, G. (2013). Learner Experiences with MOOCs and 
Open Online Learning. Hybrid Pedagogy. (http://goo.gl/frOkJy) 
(15'04'2014). 

Vidal, AA. U Camarena, B.O. (2014). Retos y posibilidades de los 
cursos en linea a partir de una experiencia concreta. Pixel-Bit, 44, 1 9' 
34. (http://goo.gl/UXXDBy) (DOI: http://doi.org/tkw) (15'04'2014). 
Yeager, C„ HurleY'Dasgupta, B. U Bliss, C.A. (2013). cMOOCs 
and Global Learning: An Authentic Aternative. Journal of Asyn- 
chronous Learning Networks, 17 (2), 133' 147. (http://goo.gl/uu3' 
FWH) (30'04'2014). 

Yuan, L. U Powell, S. (2013). MOOCs and Open Education: 
Implications for Higher Education. Cetis White Paper 2013: WP' 
03. (http://goo.gI/i5SHhi) (30'04'2014). 

ZapatA'Ros, M. (2013). MOOC, una visidn critica y una altematL 
va complementaria: la individualizacidn del aprendizaje y de la 
ayuda pedagdgica. Campus Virtuales, I, 2, 20'38. (http://goo.gl/' 
RRtaoN) (30'04'2014). 


© ISSN: 1 134'3478 • eJSSN: 1988'3293 • Pages 19'26 



